Controlling a client terminal to automatically determine image settings

ABSTRACT

The client terminal includes a candidate display control unit configured to control a candidate for a reference captured image to be displayed on a display unit, the reference captured image being retrieved based on a preliminary captured image obtained by preliminary image capture in an imaging unit and being referred to during actual image capture, and a detailed information output control unit configured to control detailed information to be output, the detailed information being attached to a reference captured image selected from among the displayed candidates for the reference captured image.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 14/786,472, filed Oct. 22, 2015, which is anational stage entry of PCT application PCT/JP2014/056188 filed Mar. 10,2014 and which claims the benefit of Japanese Priority PatentApplication 2013-095543 filed Apr. 30, 2013, the entire contents ofwhich are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates to a client terminal, a display controlmethod, a program, and a system.

BACKGROUND

In general, when a photograph is taken with a digital camera, the userselects any of a plurality of shooting scenes (e.g., portrait, nightscene, sunset, and sport), and then settings (e.g., shutter speed,aperture adjustment, and existence of electronic flash) corresponding toeach scene are automatically enabled. However, the user still manuallyselects a shooting scene.

A photograph taken has various parameters stored therein as EXIFinformation at the time of shooting, but there is no information storedregarding the user's operation used when the photograph is taken. Thus,only the EXIF information can be used to know a way of shooting thephotograph that has been taken by other people. In this regard,techniques that support photographic shooting are reported as followsbelow.

For example, Patent Literature 1 discloses an imaging device capable ofautomatically determining its imaging magnification and easilyphotographing an image with a desired composition when a photographicsubject is taken in the composition that contains a particular region ofthe photographic subject.

Patent Literature 2 discloses a technique that allows a person's face tobe photographed finely depending on the state of the face withoutmissing a chance to shoot a photograph.

Patent Literature 3 discloses a technique that shares a shot imagebetween a plurality of users over a network to build a community where arelationship is actually established.

CITATION LIST Patent Literature

-   Patent Literature 1: JP 2012-039591A-   Patent Literature 2: JP 2012-178666A-   Patent Literature 3: JP 2011-076427A

SUMMARY OF INVENTION Technical Problem

None of Patent Literatures described above have suggested that a screenused to select an image to be captured from among reference imagecandidates is displayed during image capture.

Therefore, according to the present disclosure, there is provided anovel and improved client terminal, display control method, program, andsystem capable of supporting the user's actual image capture using areference image based on preliminary image capture.

Solution to Problem

According to the present disclosure, there is provided a client terminalincluding: a candidate display control unit configured to control acandidate for a reference captured image to be displayed on a displayunit, the reference captured image being retrieved based on apreliminary captured image obtained by preliminary image capture in animaging unit and being referred to during actual image capture; and adetailed information output control unit configured to control detailedinformation to be output, the detailed information being attached to areference captured image selected from among the displayed candidatesfor the reference captured image.

According to the present disclosure, there is provided a display controlmethod including: a step of controlling a candidate for a referencecaptured image to be displayed on a display unit, the reference capturedimage being retrieved based on a preliminary captured image obtained bypreliminary image capture in an imaging unit and being referred toduring actual image capture; and a step of controlling detailedinformation to be output, the detailed information being attached to areference captured image selected from among the displayed candidatesfor the reference captured image.

According to the present disclosure, there is provided a program forcausing a computer to execute: processing of controlling a candidate fora reference captured image to be displayed on a display unit, thereference captured image being retrieved based on a preliminary capturedimage obtained by preliminary image capture in an imaging unit and beingreferred to during actual image capture; and processing of controllingdetailed information to be output, the detailed information beingattached to a reference captured image selected from among the displayedcandidates for the reference captured image.

According to the present disclosure, there is provided a systemincluding: a client terminal including a transmitter configured totransmit a preliminary captured image obtained by preliminary imagecapture to a server, a receiver configured to receives a candidate for areference captured image from the server, the reference captured imagebeing retrieved based on the preliminary captured image obtained bypreliminary image capture, a candidate display control unit configuredto control the candidate for the reference captured image received bythe receiver to be displayed on a display unit, and a detailedinformation output control unit configured to control detailedinformation to be output, the detailed information being attached to areference captured image selected from among the displayed candidatesfor the reference captured image; and a server including a storage unitconfigured to store the reference captured image, a retrieval unitconfigured to retrieve a candidate for a reference captured image fromthe storage unit based on the preliminary captured image transmittedfrom the client terminal, and a transmitter configured to transmit acandidate for a reference captured image retrieved by the retrieval unitto the client terminal.

Advantageous Effects of Invention

According to the present disclosure as described above, it is possibleto support the user's actual image capture using a reference image basedon preliminary image capture.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrated to describe an overview of a shootingsupport system according to an embodiment of the present disclosure.

FIG. 2 is a block diagram illustrating an internal configuration exampleof a digital camera according to the present embodiment.

FIG. 3 is a diagram illustrated to describe an example of a method ofdisplaying a reference image candidate according to the presentembodiment.

FIG. 4 is a diagram illustrated to describe another example of a methodof displaying a reference image candidate according to the presentembodiment.

FIG. 5 is a diagram illustrated to describe a case of outputtingdetailed information in a state before switching to actual shooting.

FIG. 6 is a diagram illustrating an example of displaying guideinformation in auto mode.

FIG. 7A is a diagram illustrating an example of displaying guideinformation in manual mode.

FIG. 7B is a diagram illustrating an example of displaying guideinformation in manual mode.

FIG. 8 is a block diagram illustrating a configuration example of aserver according to the present embodiment.

FIG. 9 is a diagram illustrated to describe a configuration example ofdata stored in a storage unit according to the present embodiment.

FIG. 10 is a sequence diagram illustrating a shooting support processaccording to the present embodiment.

FIG. 11 is a sequence diagram illustrating a re-retrieval process of areference image based on an actual shot image.

FIG. 12 is a block diagram illustrating an internal configurationexample of a digital camera according to another embodiment of thepresent disclosure.

FIG. 13 is a flowchart illustrating a shooting support process accordingto another embodiment of the present disclosure.

DESCRIPTION OF EMBODIMENTS

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in the present description and the drawings, elements that havesubstantially the same function and structure are denoted with the samereference signs, and repeated explanation is omitted.

The description is given in the following order.

1. Overview of Shooting Support System according to Embodiment ofPresent Disclosure

2. General Configuration

2-1. Configuration of Digital Camera

2-2. Configuration of Server

3. Operation Processing

4. Other Embodiments

5. Conclusion

1. OVERVIEW OF SHOOTING SUPPORT SYSTEM ACCORDING TO EMBODIMENT OFPRESENT DISCLOSURE

An overview of a shooting support system according to an embodiment ofthe present disclosure will be described with reference to FIG. 1.

FIG. 1 is a diagram illustrated to describe an overview of a shootingsupport system according to an embodiment of the present disclosure. Asshown in FIG. 1, a shooting support system according to the presentembodiment is configured to include a digital camera 1 (client terminal)and a server 2 which are connected to each other wirelessly or wired toperform data transmission and reception. Specifically, the digitalcamera 1 is connected to a network using wireless communication such aslocal area network and Wi-Fi (registered trademark), or wiredcommunication, and transmits and receives data to and from the server 2on the network.

The server 2 according to the present disclosure manages a shot imagethat is taken by the user or other people. The server 2 can transmit agiven shot image to the digital camera 1 in response to a request fromthe digital camera 1 and can receive a shot image that is photographedwith the digital camera 1 from the digital camera 1.

The digital camera 1, as shown in FIG. 1, includes a display unit 12 a(an example of an output device 12) provided on one surface of a housingthat forms the exterior of the digital camera 1. The digital camera 1includes an imaging lens or an electronic flash provided on a surface(not shown) opposite to the surface on which the display unit 12 a isprovided. The display unit 12 a may be a touch panel display thatincludes a touch sensor 11 a (an example of an input device 11) stackedthereon, and the user's operation on a display surface of the displayunit 12 a is detected.

The digital camera includes a shutter button 11 b, a zoom lever 11 c,and a power ON/OFF button (not shown) provided on a top surface thereof.

As shown in FIG. 1, various operation buttons 11 d, such as menu button,playback button, enter button, delete button, and mode switching button,are provided next to the display unit 12 a. The mode switching button isa button used to perform switching between shooting modes, such asmanual shooting mode, auto shooting mode, panorama shooting mode, andvideo shooting mode. The playback button is a button used to reproduce acaptured image, which is stored in the digital camera 1, on the displayunit 12 a.

The user, when turning on the power of the digital camera 1, sets thecamera's shooting mode to a predetermined shooting mode and directs thedigital camera 1 (specifically, an imaging lens of the camera) toward aphotographic subject (e.g., Tokyo Tower). The digital camera 1 displaysa through-the-lens image P1 on the display unit 12 a in a continuousmanner (in real time). The through-the-lens image P1 is digital data ofphotographic subject images that are sequentially captured by condensinglight using an imaging lens and receiving it using an image sensor suchas CCD. The user can check the state of framing and perform a shootingoperation while viewing the through-the-lens image P1 displayed on thedisplay unit 12 a as describe above.

When the user selects any one of a plurality of shooting scenes (e.g.,portrait, night scene, sunset, and sport) in the auto shooting mode, itis typical that setting corresponding to the selected scene (e.g.,shutter speed, shutter speed, aperture adjustment, and existence ofelectronic flash) is automatically performed.

However, the user manually selects a shooting scene and the settingcorresponding to each shooting scene is performed automatically, thusthe user may not necessarily shoot a scene with hue or atmosphere thatthe user wants to photograph. In manual shooting mode, the user canperform various settings related to shooting as desired, but the userwho has little or no professional knowledge related to shooting isdifficult to appropriately decide what type of setting is necessary toshoot a desired scene.

In view of the above circumstances, the shooting support systemaccording to the present disclosure can support the user's actualshooting by displaying a reference captured image retrieved based on thepreliminary shooting (hereinafter, referred to also as “referenceimage”) and displaying detailed information of a selected referenceimage or automatically setting a shooting parameter contained in thedetailed information. The user can use a captured image that is actuallycaptured as a reference to specifically indicate a scene to bephotographed. The detailed information related to the captured image asa reference, such as shooting parameter and shooting location orshooting date and time, is output, and thus the user can check thedetailed information of an image to be photographed and performeffectively a shooting operation that is similar to the reference image.

The reference image as a candidate may be an image captured by otheruser. The image captured by other user may be retrieved by the server 2and transmitted from the server 2, based on the image obtained throughthe preliminary shooting in the digital camera 1. This allows the userto shoot a photograph while the user feels a sense of community andfellowship.

The overview of the shooting support system according to an embodimentof the present disclosure has been described above. The configuration ofthe digital camera 1 (client terminal) and the server 2 which areincluded in the shooting support system according to the presentembodiment will be described in detail with reference to FIGS. 2 to 9.

In the example shown in FIG. 1, although the digital camera 1 isillustrated as one example of the client terminal according to thepresent embodiment, the client terminal according to the presentembodiment is not limited thereto. Examples of the client terminal mayinclude, but is not limited to, digital video cameras, mobile phoneshaving an imaging function, personal handy-phone systems (PHS),smartphones, personal digital assistants (PDA), head-mounted displays(HMD), optical see-through HMDs (eyeglass-type HMD), and notebook PCs.

2. GENERAL CONFIGURATION

<2-1. Configuration of Digital Camera>

FIG. 2 is a block diagram illustrating an internal configuration exampleof the digital camera 1 according to the present embodiment. As shown inFIG. 2, the digital camera 1 according to the present embodiment isconfigured to include a main controller 10, an input device 11, anoutput device 12, a storage unit 13, and a communication unit 14.

(Input Device)

The input device 11 is a device used to input information to the digitalcamera 1. Specifically, the input device 11 is implemented as a deviceused to input the user's operation, including a touch sensor 11 a, ashutter button 11 b, a zoom lever 11 c, and various operation buttons 11d. The touch sensor 11 a is stacked on the display unit 12 a. Theshutter button 11 b, the zoom lever 11 c, and the operation buttons 11 dare provided on the top surface of the digital camera 1.

The input device 11 may be implemented as a device including an imagingoptical system having an imaging lens, an image sensor, and an imagingmodule having an image signal processor. The image sensor may beimplemented as a charge-coupled device (CCD) imager or a complementarymetal-oxide-semiconductor (CMOS) imager. The image signal processor maybe used to perform noise reduction, gradation correction, colorcorrection, distortion correction, blurring correction,compression/decompression of image, and so on. The image processor alsoperforms a feature quantity detection process, and supplies an image andfeature quantity data of the image to the main controller 10.

The input device 11 may be implemented as a device including amicrophone and an audio signal processor. The microphone and the audiosignal processor allow the user's voice to be input.

The input device 11 supplies the input information to the maincontroller 10.

(Output Device)

The output device 12 is a device used to reproduce information output tothe user from the digital camera 1. Specifically, the output device 12is implemented as the display unit 12 a, a loudspeaker (not shown), orthe like. The display unit 12 a is implemented, for example, as a liquidcrystal display (LCD) or an organic light-emitting diode (OLED).

(Main Controller)

The main controller 10 controls components in the digital camera 1. Themain controller 10 is implemented, for example, as a microprocessor. Themain controller 10 according to the present embodiment functions as apreliminary shooting control unit 10 a, a reference image candidatedisplay control unit 10 b, a detailed information output control unit 10c, an actual shooting guide information display control unit 10 d, aparameter setting unit 10 e, and a selection notification unit 10 f, asshown in FIG. 2.

Preliminary Shooting Control Unit

The preliminary shooting control unit 10 a performs a preliminaryshooting (shooting for preview) of a photographic subject using theimaging module of the input device 11. The preliminary shooting of aphotographic subject is performed in the state where the imaging lensfaces a photographic subject to be captured by the user and thephotographic subject is contained in the through-the-lens image P1(preview screen) displayed on the display unit 12 a. In this case, theuser can only place the photographic subject to be contained in thethrough-the-lens image (to be in the range of angle of view) withoutbeing especially aware of its composition and angle.

The preliminary shooting may be performed when the user's preliminaryshooting instruction on the input device 11 is input. Specifically, thepreliminary shooting is performed, for example, when the shutter button11 b is pressed, when the touch sensor 11 a detects a contact on aphotographic subject contained in the through-the-lens image, and whenthe preliminary shooting is instructed by a voice input through amicrophone. Pressing the shutter button 11 b is used as a trigger whenactual shooting described later is performed. Thus, to distinguish thepreliminary shooting from actual shooting, for example, a first press ofthe shutter button 11 b may be set as the preliminary shooting, or thehalf-push/press-and-hold of the shutter button 11 b may be set as thepreliminary shooting.

The instruction to perform the preliminary shooting may include animplicit instruction to perform the preliminary shooting by recognizingthat the user is interested in a subject to be photographed, in additionto the explicit instruction to perform the preliminary shooting by theuser. An example of the implicit instruction to perform the preliminaryshooting includes a case where the through-the-lens image P1 issuspended for a predetermined time (a case where there is no movementfor a given time while a photographic subject is being contained in thethrough-the-lens image). In this case, the preliminary shooting controlunit 10 a recognizes that the user is interested in a photographicsubject contained in the through-the-lens image P1 and accordinglyperforms the preliminary shooting. When the digital camera 1 is providedwith a front-facing camera (a camera provided to face the user acting asa photographer), the main controller 10 can detect the direction of theuser's line of sight by the front-facing camera. When the user's line ofsight is looking at a particular photographic subject within thethrough-the-lens image for a predetermined time based on the detecteddirection of the user's line of sight, the preliminary shooting controlunit 10 a recognizes that the user is interested in the photographicsubject and performs the preliminary shooting. The digital camera 1 maybe provided with a viewfinder having a function of detecting the user'sline of sight, in addition to such a front-facing camera. In this case,when the user's line of sight is looking at a particular photographicsubject within the through-the-lens image for a predetermined time basedon the direction of the user's line of sight detected by the viewfinder,the preliminary shooting control unit 10 a recognizes that the user isinterested in the photographic subject and can perform the preliminaryshooting. In this way, when it is indicated that the user is interestedin a particular photographic subject based on a fact that an imaginglens remains stationary while facing the photographic subject or a factthat the user looks at the photographic subject contained in thethrough-the-lens image for a predetermined time, the preliminaryshooting control unit 10 a allows the preliminary shooting to beperformed.

The preliminary shooting control unit 10 a controls a preliminary shotimage obtained through the preliminary shooting to be transmitted to theserver 2 via the communication unit 14 together with the featurequantity (color or shape of a photographic subject) detected from theimage obtained through preliminary shooting by the image signalprocessor.

Reference Image Candidate Display Control Unit

The reference image candidate display control unit 10 b controls areference image candidate (a candidate for a reference captured image)transmitted from the server 2 via the communication unit 14 to bedisplayed on the display unit 12 a. The server 2 retrieves a shot imageobtained by photographing the same or similar photographic subject,based on the preliminary shot image and feature quantity datatransmitted from the digital camera 1, and transmits the retrieved shotimage as a reference image candidate to the digital camera 1, which willbe described in detail later. For example, when the through-the-lensimage P1 shown in FIG. 1 is obtained through the preliminary shooting(hereinafter, referred to as “preliminary shot image P1”), the server 2retrieves a captured image obtained by capturing the same “Tokyo Tower”or a captured image obtained by capturing a similar other towers (e.g.,the Eiffel Tower and Tokyo Skytree) based on the feature quantity dataof the photographic subject “Tokyo Tower” contained in the preliminaryshot image P1. The captured image to be retrieved may be an imagecaptured previously by the user or may be an image captured by otherusers. The server 2 transmits the captured image retrieved in this wayto the digital camera 1 as a reference image candidate. The server 2 mayform a list of the reference image candidates to be transmitted in theorder of obtained scores based on scores and then may transmit listedcandidates. This allows the reference image candidate display controlunit 10 b to display a captured image, which is obtained by capturing asubject being photographed by the user or a similar photographicsubject, on the display unit 12 a as a reference image candidate.

Selection of any of the displayed reference image candidates may beperformed by pressing the enter button or assist button of the variousoperation buttons 11 d, performing a touch operation (or long tapoperation/double tap operation) on the reference image candidatedetected by the touch sensor 11 a, or inputting a voice through amicrophone (not shown). Alternatively, Selection of any of the displayedreference image candidates may be performed by inputting the line ofsight using a front-facing camera.

A method of displaying a reference image candidate by the referenceimage candidate display control unit 10 b is not limited to a particularmethod. For example, a display method that will be described later withreference to FIGS. 3 and 4 may be used.

FIG. 3 is a diagram illustrated to describe an example of a method ofdisplaying a reference image candidate according to the presentembodiment. As shown on the left part of FIG. 3, when the user performsthe preliminary shooting with the digital camera 1 facing a photographicsubject, reference image candidates C1, C2, C3, and C4 are overlaid on amap image P2 displayed on the display unit 12 a of the digital camera 1,as shown on the right part of FIG. 3. Specifically, the reference imagecandidate display control unit 10 b displays landmark icons indicatingthe shooting location of each of the reference image candidates C1 to C4transmitted from the server 2 on the map image P2, and displays thereference image candidates C1 to C4 in association with thecorresponding landmark icons.

The reference image candidate display control unit 10 b may display areference image in order of its ranking. Specifically, reference imagesmay be displayed in the order of ranking in the reference image list,which is transmitted from the server 2 and arranged in the order ofscores based on score information, or the ranking list based on thescore information attached to each of the reference image. In theexample illustrated in FIG. 3, the obtained scores are arranged in theorder of reference image candidates C1, C2, C3, and C4, and thus thesize of the respective images becomes smaller in the order of referenceimage candidates C1, C2, C3, and C4, as shown in FIG. 3.

The screen having such reference image candidates displayed thereon maybe generated by the server 2 and transmitted from the server 2.Alternatively, the reference image candidate display control unit 10 bmay generate the reference image candidates so that they are controlledto be displayed on the map image P2 based on the shooting location andscore information attached to each of the reference image candidates C1to C4.

The user selects a captured image having a composition, an angle, aneffect, and a hue to be photographed from among the reference imagecandidates C1 to C4 (e.g., it is selected using a touch operation). Inthis way, displaying a captured image actually captured by the user orother users allows the user to form a clear idea of a captured image tobe photographed and to specify the desired composition, angle, or thelike in detail. In the example shown in FIG. 3, although four referenceimage candidates C1 to C4 are displayed, when an indication 30 presentedby “other” on the lower right of the display unit 12 a is selected,other reference image candidates (e.g., candidates being ranked fifth orlower) are displayed.

The reference image candidates C1 to C4 are displayed in different sizein accordance with their scores, and thus the user can intuitivelyrecognize a popular reference image.

Furthermore, a landmark icon indicating a shooting location of each ofthe reference image candidates C1 to C4 is displayed on the map imageP2, and thus the user can intuitively recognize a place to be moved toobtain a captured image similar to the desired reference imagecandidate. When the digital camera 1 is provided with the globalpositioning system (GPS) positioning device, the reference imagecandidate display control unit 10 b can also display a current positionicon that indicates the current position of the user on the map imageP2. This allows the user to intuitively recognize a positionalrelationship between the current position and the shooting location ofeach of the reference image candidates C1 to C4.

FIG. 4 is a diagram illustrated to describe another example of a methodof displaying a reference image candidate according to the presentembodiment. As shown in FIG. 4, the preliminary shot image P1 (athrough-the-lens image) is displayed on the display unit 12 a of thedigital camera 1, and the reference image candidates C1 to C4 aredisplayed on the preliminary shot image (a through-the-lens image) P1.As shown in FIG. 4 for example, when a grip portion (a right endportion) of the digital camera 1 is hold with the right hand, thereference image candidates C1 to C4 are all displayed within the movablerange in the case of moving the thumb while holding the digital camera1. The reference image candidate display control unit 10 b displays areference image candidate having a higher score (higher ranking) at aposition close to the thumb, and thus it is possible for the user toeasily select a reference image candidate having a higher ranking.

The reference image candidate display control unit 10 b can display theranking order corresponding to each of the reference image candidates C1to C4 near each of the reference image candidates, as shown in FIG. 4.

In the example shown in FIG. 4, although only four reference imagecandidates C1 to C1 are displayed, when an indication 30 presented by“other” below the display unit 12 a is selected, other reference imagecandidates (e.g., candidates being ranked fifth or lower) are displayed.

The reference image candidate display control unit 10 b has beendescribed above in detail.

Detailed Information Output Control Unit

The detailed information output control unit 10 c controls the detailedinformation to be displayed on the display unit 12 a or to be output asa voice from a loudspeaker (not shown). The detailed information isattached to a reference image candidate that is selected from among thereference image candidates displayed on the display unit 12 a. Examplesof detailed information as used herein include shooting parameter(camera setting information), shooting location (position) information,shooting date and time information, rotation information, modelinformation, and score information.

The detailed information output control unit 10 c may output thedetailed information attached to a reference image candidate that isselected from among the reference image candidates displayed on thedisplay unit 12 a in the state before switching to the actual shooting,or may output the detailed information in the state after switching tothe actual shooting.

As an example, a case of outputting the detailed information in thestate before switching to the actual shooting will be described withreference to FIG. 5. For example, when the reference image candidate C1displayed on the display unit 12 a is touched, the user's selectionoperation is detected by the touch sensor 11 a, and the detailedinformation output control unit 10 c displays detailed information ofthe reference image candidate C1 (shooting setting information, shootinglocation and date/time information, ranking information) as shown inFIG. 5. This allows the user to recognize detailed information of acaptured image to be photographed. When an operation is performed toconfirm selection of the reference image candidate C1, the maincontroller 10 switches the shooting mode to the actual shooting mode.The operation of confirming selection of the reference image candidateC1 may correspond to, for example, a long tap or double tap on theregion in which the reference image candidate C1 is displayed, or adepression of the enter button among the various operation buttons 11 d.

Outputting the detailed information in the state after switching to theactual shooting will be described later with reference to FIGS. 7A and7B.

Actual Shooting Guide Information Display Control Unit

When a reference image candidate is selected from among the referenceimage candidates displayed on the display unit 12 a and the shootingmode is switched to the actual shooting mode, the actual shooting guideinformation display control unit 10 d controls shooting assistinformation corresponding to the selected reference image to bedisplayed. The shooting assist information may be guide information usedto guide the composition or angle of the actual shooting based on aresult obtained by analyzing the reference image or detailed informationattached to the reference information.

For example, when the detailed information attached to the referenceimage contains rotation information, the actual shooting guideinformation display control unit 10 d allows the user to know whetherthe reference image is shot in the lateral direction or in thelongitudinal direction based on the rotation information. As an example,when the reference image is shot in the longitudinal direction, theactual shooting guide information display control unit 10 d displays athumbnail of the reference image on a preview screen (through-the-lensimage) for the actual shooting in the lateral direction, and thus theuser is guided to move the digital camera 1 in the lateral direction.

The actual shooting guide information display control unit 10 d displaysan auxiliary line used to achieve the composition or angle that issimilar to that of the reference image on the preview screen(through-the-lens image) for actual shooting depending on a resultobtained by analyzing the reference image, thereby guiding the user'sshooting operation (adjustment of zoom or image capturing direction).

In this way, a guiding mark used to perform a shooting with thecomposition or at the angle, which is similar to that of the referenceimage, is displayed, and thus it is possible for the user to shooteffectively an image to be photographed. A specific example ofdisplaying shooting assist information will be described later withreference to FIGS. 6 and 7.

Parameter Setting Unit

When a reference image candidate is selected from among the referenceimage candidates displayed on the display unit 12 a and the shootingmode is switched to the actual shooting mode, the parameter setting unit10 e controls a shooting parameter similar to the selected referenceimage to be set automatically. Examples of the shooting parameterinclude aperture adjustment (f-number), shutter speed, ISO sensitivity,white balance, existence of electronic flash. This allows the user toshoot effectively an image to be photographed without any trouble ofsetting by the user.

The parameter setting unit 10 e according to the present embodiment mayset a shooting parameter in auto mode and may not set a shooting mode inmanual mode. An example of displaying a shooting parameter and guideinformation during the actual shooting will be described in detail withreference to FIGS. 6 and 7.

FIG. 6 is a diagram illustrating an example of displaying guideinformation in auto mode. In the example shown in FIG. 6, the referenceimage candidate C1 is selected from among the reference image candidatesC1 to C4 described above with reference to FIGS. 3 and 4, and a displayscreen example in the state after switching to the actual shooting modeis illustrated.

As shown in the left part of FIG. 6, a preview screen (through-the-lensimage P3) for the actual shooting, which is successively captured by theimaging lens, is displayed on the display unit 12 a of the digitalcamera 1 in real time. The actual shooting guide information displaycontrol unit 10 d according to the present embodiment displays areference image R, which is a thumbnail of the reference image candidateC1, on the preview screen (through-the-lens image P3) for the actualshooting in the longitudinal direction depending on rotation information(90 degree rotation/longitudinal direction) of the reference imagecandidate C1. The actual shooting guide information display control unit10 d displays an auxiliary line 31 used to achieve the compositionsimilar to that of the reference image candidate C1 on the previewscreen (through-the-lens image P3) for the actual shooting based on aresult obtained by analyzing the reference image candidate C1.

Thus, the user can rotate the digital camera 1 to be the longitudinaldirection as shown in the right part of FIG. 6 and can change theshooting direction to move the digital camera 1 so that a photographicsubject is overlapped on the auxiliary line 31. This allows the user toachieve the composition or direction (rotation direction) similar tothat of the reference image R.

The parameter setting unit 10 e sets a similar shooting parameter basedon the shooting parameter attached to the reference image candidate C1.In the auto mode of the example shown in FIG. 6, the shooting parameteris automatically set by the parameter setting unit 10 e. Thus, thedetailed information output control unit 10 c does not display detailedinformation (including shooting parameters).

In this way, it is possible for the user to effectively shoot an imagesimilar to the reference image R that is an image to be photographed bymoving the digital camera 1 along the direction of the reference image Ror the auxiliary line 31 without any trouble of setting of shootingparameters.

An example of displaying guide information in manual mode will bedescribed with reference to FIGS. 7A and 7B. FIGS. 7A and 7B arediagrams illustrating an example of displaying guide information inmanual mode. In the example shown in FIGS. 7A and 7B, the referenceimage candidate C1 is selected from among the reference image candidatesC1 to C4 described above with reference to FIGS. 3 and 4, and a displayscreen example in the state after switching to the actual shooting modeis illustrated.

As shown in FIG. 7A, a preview screen (through-the-lens image P3) forthe actual shooting, which is successively captured by the imaging lens,is displayed on the display unit 12 a of the digital camera 1 in realtime, as is the case in FIG. 6. The actual shooting guide informationdisplay control unit 10 d displays a reference image R, which is athumbnail of the reference image candidate C1, on the preview screen(through-the-lens image P3) for the actual shooting in the longitudinaldirection depending on rotation information of the reference imagecandidate C1, as is the case in FIG. 6. The actual shooting guideinformation display control unit 10 d displays an auxiliary line 31 usedto achieve the composition similar to that of the reference imagecandidate C1 on the preview screen (through-the-lens image P3) for theactual shooting based on a result obtained by analyzing the referenceimage candidate C1. Thus, the user can rotate the digital camera 1 to bethe longitudinal direction as shown in the right portion of FIG. 6 andcan change the shooting direction to move the digital camera 1 so that aphotographic subject is overlapped on the auxiliary line 31. This allowsthe user to achieve the composition or direction (rotation direction)similar to that of the reference image R.

The detailed information output control unit 10 c displays detailedinformation 33 attached to the reference image candidate C1 (referenceimage R), as shown in FIG. 7A. The detailed information 33 may contain ashooting parameter (e.g., F-number and shutter speed), shootinglocation, and shooting date and time. This allows the user to set ashooting parameter of the digital camera 1 by referring to a displayedshooting parameter, to change a shooting place, or to wait until adesired shooting date and time is reached, and thus the user can shootan image similar to the reference image R. In the manual mode of theexample shown in FIG. 7A, the detailed information output control unit10 c displays the detailed information 33 that contains a shootingparameter, and thus an automatic setting of a shooting parameter by theparameter setting unit 10 e is not performed.

The actual shooting guide information display control unit 10 d maydisplay an indication 35 (an example of shooting guide information) usedto describe how to hold (way of holding) the digital camera 1 orconsiderations, as shown in FIG. 7B.

In this way, it is possible for the user to recognize the contents ofthe shooting parameter of the reference image R. Thus, the user can seta shooting parameter of the digital camera 1, move the digital camera 1in accordance with the direction of the reference image R or theauxiliary line 31, or change a location in accordance with the guidanceof the shooting location. Accordingly, the user can effectively shoot animage to be photographed. The shooting location or shooting date andtime of the reference image R shown in FIG. 7A or 7B may be displayed inthe auto mode described above with reference to FIG. 6. The indication35 used to describe how to hold (way of holding) the digital camera 1 orconsiderations shown in FIG. 7B may be displayed in the auto modedescribed above with reference to FIG. 6.

Selection Notification Unit

The selection notification unit 10 f controls a reference imagecandidate, which is selected from among the reference image candidatesdisplayed on the display unit 12 by the reference image candidatedisplay control unit 10 b, to be notified to the server 2 via thecommunication unit 14. Such a notification allows the server 2 to updatea score (the number of reference times) of the reference image, whichwill be described later.

(Storage Unit)

The storage unit 13 is a storage medium that stores an image obtainedthrough the actual shooting. For example, the storage unit 13 may beimplemented by flash memory such as card-type memory. The storage unit13 includes read-only memory (ROM) on which a program used for the maincontroller 10 to execute each function described above is stored orrandom-access memory (RAM) used as a working area when the maincontroller 10 executes each function described above.

(Communication Unit)

The communication unit 14 transmits and receives data to and from anexternal device via a wired or wireless connection. Specifically, forexample, the communication unit 14 is connected to a network viawireless communication such as wireless LAN and Wi-Fi (registeredtrademark) or wired communication, and transmits and receives data toand from the sever 2 on the network.

The configuration of the digital camera 1 according to the presentembodiment has been described above. The configuration of the sever 2according to the present embodiment will be described with reference toFIGS. 8 and 9.

<2-2. Configuration of Server>

FIG. 8 is a block diagram illustrating the configuration of the server 2according to the present embodiment. As shown in FIG. 8, the server 2 isconfigured to include a main controller 20, a storage unit 23, and acommunication unit 24.

(Main Controller)

The main controller 20 controls components in the server 2. The maincontroller 20 is implemented, for example, as a microprocessor. The maincontroller 20 according to the present embodiment functions as areference image retrieval unit 20 a and a score management unit 20 b, asshown in FIG. 8.

Reference Image Retrieval Unit

The reference image retrieval unit 20 a retrieves other shot images(reference image), which are obtained by photographing a subject or asimilar subject included in the preliminary shot image, from the storageunit 23, based on the preliminary shot image and feature quantity datatransmitted from the digital camera 1. The reference image retrievalunit 20 a transmits a list of the retrieved shot images (reference imagelist) to the digital camera 1. A reference image transmitted to thedigital camera 1 contains shooting setting information (shootingparameter), shooting location information, shooting date and timeinformation, ranking information based on a score, model information,which are attached thereto, as detailed information. The reference imageretrieval unit 20 a can retrieves other shot images, which have thecomposition, angle, and effect similar to those of the preliminary shotimage, from the storage unit 23 as a reference image.

Score Management Unit

The score management unit 20 b updates a score of the shot image(reference image) indicated by the selection notification transmittedfrom the digital camera 1 depending on the selection notification. Thescore indicates the number of times that a shot image is selected as areference image (selected for reference upon the actual shooting) in thedigital camera 1. The server 2 receives a selection notification from aplurality of digital cameras 1 and updates a score of each shot imagestored in the storage unit 23, thereby ranking shot images (referenceimage) in the order of popularity among a plurality of users.

(Storage Unit)

The storage unit 23 is a storage medium that stores a shot image. Thestorage unit 23 includes read-only memory (ROM) on which a program usedfor the main controller 20 to execute each function described above isstored or random-access memory (RAM) used as a working area when themain controller 20 executes each function described above.

A data configuration example of a shot image stored in the storage unit23 will be described with reference to FIG. 9. FIG. 9 is a diagramillustrating an example of a data item 231 stored in the storage unit23. The storage unit 23 stores each shot image (reference image) inassociation with detailed information, photographic subject information,and score information, as shown in FIG. 9.

The detailed information is metadata of a shot image including shootingparameter, shooting date/time and location information, holdingdirection (rotation information), thumbnail image, or the like.

The photographic subject information is a name of a photographic subjector feature quantity data of a photographic subject (color or shape of aphotographic subject) determined by the main controller 20 based on aresult obtained by analyzing a shot image (including feature quantitydata). In the example shown in FIG. 9, each shot image is associatedwith the name of the photographic subject of “Tokyo Tower”, asphotographic subject information. In this way, each shot image ispreviously associated with the name of a photographic subject or featurequantity data of a photographic subject, and thus it is possible for thereference image retrieval unit 20 a to perform retrieval processing moreeffectively.

The score information indicates the number of times that is selected asan image to be a reference at the time of actual shooting in the digitalcamera 1 as described above, and the score information is updated by thescore management unit 20 b.

(Communication Unit)

The communication unit 24 transmits and receives data to and from anexternal device via a wired or wireless connection. Specifically, forexample, the communication unit 24 is connected to a network via wiredcommunication, and transmits and receives data to and from the digitalcamera 1 over the network.

The configuration of the server 2 according to the present embodimenthas been described above in detail. The operation process procedure ofthe shooting support system according to the present embodiment will bedescribed with reference to FIGS. 10 and 11.

3. OPERATION PROCESSING

FIG. 10 is a sequence diagram illustrating a shooting support processaccording to the present embodiment. As shown in FIG. 10, in step S103,the preliminary shooting control unit 10 a of the digital camera 1executes a preliminary shooting.

In step S106, the digital camera 1 transmits an image obtained throughthe preliminary shooting to the server 2 via the communication unit 14.In this case, the digital camera 1 may transmit feature quantity data ofthe preliminary shot image, in addition to the preliminary shot image.

In step S109, the reference image retrieval unit 20 a of the server 2retrieves a reference image based on the preliminary shot imagetransmitted from the digital camera 1. Specifically, the reference imageretrieval unit 20 a retrieves other shot images (reference image), whichare obtained by photographing a photographic subject included in thepreliminary shot image or a similar photographic subject, from thestorage unit 23 based on the preliminary shot image and the featurequantity data.

In step S112, the reference image retrieval unit 20 a of the server 2forms a list of reference images in the order of their scores usingscore information of the respective reference images retrieved from thestorage unit 23.

In step S115, the server 2 transmits the reference image list anddetailed information attached to the respective reference images to thedigital camera 1. In this case, the server 2 may transmit the scoreinformation associated with the respective reference images with thescore information included in the detailed information.

In step S118, the reference image candidate display control unit 10 b ofthe digital camera 1 controls a reference image candidate to bedisplayed on the display unit 12 a in accordance with the referenceimage list transmitted from the server 2. Specifically, the referenceimage candidate display control unit 10 b displays a predeterminednumber of reference image candidates having higher rank in the list onthe display unit 12 a, or controls the position to be displayed or thesize of the displayed image in accordance with the order of rank in thelist.

In step S121, the digital camera 1 accepts the user's selection of areference image among the reference image candidates displayed on thedisplay unit 12 a. The selection of a reference image is an operationperformed by the user to select an image for reference during actualshooting.

In step S124, the selection notification unit 10 f of the digital camera1 provides a notification indicating that a reference image is selectedto the server 2.

In step S127, the score management unit 20 b of the server 2 incrementsthe score of the selected image that is stored in the storage unit 23and updates the scores, based on the selection notification from thedigital camera 1.

On the other hand, in step S130, the main controller 10 of the digitalcamera 1 switches the shooting mode to the actual shooting mode, andperforms the setting of a shooting parameter based on the referenceimage selected by the user and displays the set shooting parameter andactual shooting guide information. Specifically, for example, thedetailed information output control unit 10 c controls the shootingparameter or information such as the shooting location and date/timeinformation of the reference image R selected by the user to bedisplayed on a preview screen for the actual shooting. The actualshooting guide information display control unit 10 d displays anauxiliary line used to achieve the composition or angle similar to thatof the reference image R in the preview screen for actual shooting. Theparameter setting unit 10 e sets a shooting parameter similar to that ofthe selected reference image R.

In step S133, the main controller 10 of the digital camera 1 executesthe actual shooting, and stores a shot image obtained by the actualshooting in the storage unit 13. The execution of the actual shooting isperformed by depressing the shutter button 11 b or by detecting a tapoperation of the actual shooting button image displayed on the displayunit 12 a as a trigger.

As described above, the shooting support process according to thepresent embodiment makes it possible for the user to effectively shootan image to be photographed using factors such as a composition or anangle, an effect, and camera settings (setting of shooting parameters),similar to those of the reference image selected by the user. In stepS115 described above, the server 2 transmits the reference image list tothe digital camera 1. However, data to be transmitted to the digitalcamera 1 by the server 2 is not limited to the reference image list. Forexample, the server 2 may only transmit a single or a plurality ofreference images and the detailed information and score informationattached to the reference image. The server 2 may generate a referenceimage candidate screen based on the retrieved reference image andtransmit it to the digital camera 1.

The shooting support process according to the present embodiment is notlimited to the process illustrated in FIG. 10. For example, the shootingsupport process according to the present embodiment may perform aprocess for re-retrieving a reference image based on the shot imageobtained by the actual shooting and presenting the re-retrievedreference image to the user (feedback process), thereby narrowing downthe number of reference images. Thus, a reference image matching theuser's desire (preference) may be presented to the user.

In other words, when a preliminary shooting is performed only bydirecting the imaging lens to a photographic subject withoutconsideration of composition or the like, the shot image having variouscompositions, camera angles, and effects, obtained by shooting the sameor similar photographic subject based on the preliminary shot image ispresented as a reference image. Then, when the actual shooting isperformed after the composition or shooting position is adjusted basedon the reference image, the shot image having the same or similarcomposition, angle, and effect, obtained by shooting the same or similarphotographic subject based on the actual shot image is presented as areference image. The actual shooting and the presentation of thereference image retrieved based on the actual shooting can be repeatedlyperformed, and thus the number of reference images is narrowed down,thereby presenting a shot image having higher technology as a candidate.A re-retrieval process based on the actual shooting as described abovewill be described in detail with reference to FIG. 11.

FIG. 11 is a sequence diagram illustrating a process for re-retrieving areference image based on the actual shot image. As shown in FIG. 11, instep S133, the main controller 10 of the digital camera 1 performs theactual shooting and stores a shot image obtained by the actual shootingin the storage unit 13 (a process similar to the same step shown in FIG.10).

In step S136, the digital camera 1 transmits the actual shot image tothe server 2. In this case, the digital camera 1 may transmit featurequantity data of the actual shot image together with the actual shotimage.

In step S139, the reference image retrieval unit 20 a of the server 2retrieves a reference image based on the actual shot image transmittedfrom the digital camera 1. Specifically, the reference image retrievalunit 20 a retrieves other shot images (reference image) from the storageunit 23 based on the actual shot image and the feature quantity data.The other shot images are obtained by photographing a photographicsubject that is the same or similar to a photographic subject includedin the image obtained by the actual shooting with the same or similarcomposition, camera angle, and effect to those of the image obtained bythe actual shooting.

In step S142, the reference image retrieval unit 20 a of the server 2forms a list of reference images in the order of their scores usingscore information of the respective reference images retrieved from thestorage unit 23.

In step S145, the server 2 transmits the reference image list anddetailed information attached to the respective reference images to thedigital camera 1.

In step S148, the reference image candidate display control unit 10 b ofthe digital camera 1 controls a reference image candidate to bedisplayed on the display unit 12 a in accordance with the referenceimage list transmitted from the server 2.

In step S151, the digital camera 1 accepts the selection of a referenceimage by the user among the reference image candidates displayed on thedisplay unit 12 a.

In step S154, the selection notification unit 10 f of the digital camera1 provides a notification indicating that a reference image is selectedto the server 2.

In step S157, the score management unit 20 b of the server 2 incrementsthe score of the selected reference image stored in the storage unit 23and updates the scores, based on the selection notification from thedigital camera 1.

On the other hand, in step S160, the main controller 10 of the digitalcamera 1 performs the setting of a shooting parameter based on thereference image selected by the user and displays the set shootingparameter and actual shooting guide information. Specifically, forexample, the detailed information output control unit 10 c controls theshooting parameter or information such as the shooting location anddate/time information of the reference image R selected by the user tobe displayed on a preview screen for the actual shooting. The actualshooting guide information display control unit 10 d displays anauxiliary line used to achieve composition or angle similar to that ofthe reference image R in the preview screen for the actual shooting. Theparameter setting unit 10 e sets a shooting parameter similar to that ofthe selected reference image R.

In step S163, the main controller 10 of the digital camera 1 executesthe actual shooting, and stores a shot image obtained through the actualshooting in the storage unit 13.

In step S166, the digital camera 1 transmits the image obtained throughthe actual shooting to the server 2, and then steps S139 to S166 arerepeated.

As described above, the shooting support process according to thepresent embodiment makes it possible to narrow down the number ofreference images to be presented to the user by performing repeatedlythe actual shooting and the re-retrieval of reference images based onthe actual shooting. This allows the user to select a new composition,effect, camera angle, camera settings (shooting parameter), or the likeevery time the actual shooting is performed, thereby ensuring acontinuation of interactive shooting.

4. OTHER EMBODIMENTS

The embodiment described above with reference to FIGS. 1 to 11 isdirected to the shooting support system configured to include thedigital camera 1 (client terminal) and the server 2. However, mainfunctions of the shooting support system according to the presentembodiment may be executed only by the digital camera 1. A shootingsupport system including the digital camera 1 alone will be described indetail with reference to FIGS. 12 and 13.

<4-1. Configuration of Digital Camera>

FIG. 12 is a block diagram illustrating an internal configurationexample of a digital camera 1′ according to another embodiment of thepresent disclosure. As shown in FIG. 12, the digital camera 1′ accordingto the present embodiment is configured to include a main controller10′, an input device 11, an output device 12, a storage unit 13′, and acommunication unit 14. The input device 11, the output device 12, andthe communication unit 14 are similar to the respective componentsdescribed above with reference to FIG. 2, and thus the descriptionthereof will be omitted.

(Main Controller)

The main controller 10′ controls components in the digital camera 1′.The main controller 10′ is implemented, for example, as amicroprocessor. The main controller 10′ according to the presentembodiment functions as a preliminary shooting control unit 10 a, areference image candidate display control unit 10 b, a detailedinformation output control unit 10 c, an actual shooting guideinformation display control unit 10 d, a parameter setting unit 10 e, areference image retrieval unit 10 g, and a score management unit 10 h,as shown in FIG. 12. The preliminary shooting control unit 10 a, thereference image candidate display control unit 10 b, the detailedinformation output control unit 10 c, the actual shooting guideinformation display control unit 10 d, the parameter setting unit 10 eare similar to the respective components described above with referenceto FIG. 2, and thus the description thereof will be omitted.

Reference Image Retrieval Unit

The reference image retrieval unit 10 g retrieves a reference imagebased on a preliminary shot image photographed by the preliminaryshooting control unit 10 a. A specific method of retrieval is similar tothat performed by the reference image retrieval unit 20 a describedabove with reference to FIG. 8, and thus the description thereof will beomitted. The reference image retrieval unit 10 g supplies the retrievedreference image candidate (or a reference image list made in the orderof score) to the reference image candidate display control unit 10 b.

Score Management Unit

The score management unit 10 h updates a score (the score indicating thenumber of reference times) stored in the storage unit 13′ so that thescore is associated with a reference image selected for the user'sreference during the actual shooting from among reference imagecandidates displayed on the display unit 12 a by the reference imagecandidate display control unit 10 b.

(Storage Unit)

The storage unit 13′ is a storage medium that stores a shot image. Thestorage unit 13′ includes read-only memory (ROM) on which a program usedfor the main controller 20 to execute each function described above isstored or random-access memory (RAM) used as a working area when themain controller 20 executes each function described above.

The storage unit 13′ according to the present embodiment stores a shotimage obtained by actual shooting in the digital camera 1′ or a shotimage that is captured by other user and is obtained from the outsidevia the communication unit 14. The storage unit 13′ stores each shotimage (reference image) in association with detailed information,photographic subject information, and score information, as is the casewith the storage unit 23 described above with reference to FIG. 8.

The configuration described above allows the digital camera 1′ accordingto the present embodiment to retrieve a reference image from thebuilt-in storage unit 13′ based on the preliminary shot image obtainedthrough the preliminary shooting in the digital camera 1, and allows thedigital camera 1′ to display a reference image candidate on the displayunit 12 a. The reference image retrieval unit 10 g of the digital camera1′ may retrieve a reference image from an external storage deviceconnected via the communication unit 14, in addition to the built-instorage unit 13′.

<4-2. Operation Process>

The operation process procedure according to the present embodiment willbe described with reference to FIG. 13. FIG. 13 is a flowchartillustrating a shooting support process according to another embodimentof the present disclosure.

As shown in FIG. 13, in step S203, the preliminary shooting control unit10 a of the digital camera 1′ executes a preliminary shooting.

In step S206, the reference image retrieval unit 10 g of the digitalcamera 1′ retrieves a reference image based on the preliminary shotimage. Specifically, the reference image retrieval unit 10 g retrievesother shot images (reference image), which are obtained by photographinga photographic subject that is the same or similar to a photographicsubject included in the preliminary shot image, from the storage unit13′ based on the preliminary shot image and the feature quantity datadetected from the preliminary shot image.

In step S209, the reference image retrieval unit 10 g forms a list ofreference images in the order of their scores using score information ofthe respective reference images retrieved from the storage unit 13′.

In step S212, the reference image candidate display control unit 10 b ofthe digital camera 1′ controls a reference image candidate to bedisplayed on the display unit 12 a in accordance with the referenceimage list supplied from the reference image retrieval unit 20 g.

In step S215, the digital camera 1′ accepts the user's selection of areference image among the reference image candidates displayed on thedisplay unit 12 a.

In step S218, the score management unit 10 h of the digital camera 1′increments the score of the selected reference image stored in thestorage unit 13′ and updates the scores, depending on acceptance of theselection of reference image.

In step S221, the main controller 10′ of the digital camera 1′ switchesthe shooting mode to the actual shooting mode, and then performs thesetting of a shooting parameter based on the reference image selected bythe user and displays the set shooting parameter and actual shootingguide information.

In step S224, the main controller 10′ of the digital camera 1′ executesthe actual shooting, and stores a shot image obtained by the actualshooting in the storage unit 13′.

As described above, the digital camera 1′ according to anotherembodiment of the present disclosure allows a reference image to beretrieved based on a preliminary shot image and allows a reference imagecandidate to be displayed on the display unit 12 a.

5. CONCLUSION

As described above, the shooting support system according to the presentembodiment displays a reference image obtained by retrieval based on thepreliminary shooting, and displays detailed information of the selectedreference image or sets automatically a shooting parameter included inthe detailed information, thereby supporting the user to perform theactual shooting.

Although the preferred embodiments of the present disclosure have beendescribed in detail with reference to the appended drawings, the presentdisclosure is not limited thereto. A person skilled in the art may findvarious alterations and modifications within the scope of the appendedclaims, and it should be understood that they will naturally come underthe technical scope of the present disclosure.

For example, a computer program, which is used to cause hardware such asCPU, ROM, and RAM included in the digital camera 1 (or digital camera1′) or the server 2 to execute functions of the digital camera 1 (ordigital camera 1′) or the server 2 described above, can be created.There is provided a computer-readable storage medium having the computerprogram stored thereon.

The steps in the processing procedure performed by the digital camera 1(or digital camera 1′) or the server 2 herein may be not necessarilyprocessed in time series according to the order described in theaccompanying flowcharts and sequence diagrams. For example, the steps inthe processing procedure performed by the digital camera 1 (or digitalcamera 1′) or the server 2 may be processed in a different order fromthat described in the sequence diagram or the flowchart, or may beperformed in a parallel manner. Specifically, in FIG. 10, steps S124 toS127 and S130 to S133 may be processed in reverse order or may beprocessed in parallel.

The method of selecting a reference image from reference imagecandidates displayed on the display unit 12 a may include automaticallyselecting a reference image in the order of ranking (the order of list)in addition to the manual selection by the user as described above. Inother words, the main controller 10 of the digital camera 1 switches theshooting mode to the actual shooting mode, for example, withoutpresentation of a reference image after the preliminary shooting. Theparameter setting unit 10 e controls a shooting parameter to be set tobe similar to a reference image selected in a random way orautomatically in the order of lists from among reference imagecandidates when actual shooting is performed by pressing the shutterbutton 11 b. In this way, the digital camera 1 according to theembodiment allows a reference image to be automatically selected fromreference image candidates without the manual selection (selectionoperation) by the user, and allows a shooting parameter of the referenceimage to be set during actual shooting. This makes it possible for theuser to shoot an image with different settings (shooting parameters)each time the shutter button 11 b is pressed.

The detailed information output control unit 10 c allows the detailedinformation to be output from an external display device or externalaudio output device in addition to from the display unit 12 a or anaudio output unit (loudspeaker) provided in the digital camera 1 (clientterminal). For example, when the client terminal according to thepresent disclosure does not include an output device such as a displayunit or audio output unit, the detailed information output control unit10 c allows the detailed information to be output from a handheld mobileterminal (e.g., smartphones and tablets). The case where the clientterminal does not include an output device is, for example, when theclient terminal is a head-mounted display or eyeglass-type wearabledevice provided with an action camera or built-in camera.

A method of using a score (a score indicating the number of referencetimes) that is associated with a reference image may be used torecognize the user preference trends and to collect statistics ofpopular shooting spot, popular shooting time zone, or popular camerasettings (popular shooting parameter setting), in addition to theforming a list of reference images as described above.

Additionally, the present technology may also be configured as below.

(1) A client terminal including:

a candidate display control unit configured to control a candidate for areference captured image to be displayed on a display unit, thereference captured image being retrieved based on a preliminary capturedimage obtained by preliminary image capture in an imaging unit and beingreferred to during actual image capture; and

a detailed information output control unit configured to controldetailed information to be output, the detailed information beingattached to a reference captured image selected from among the displayedcandidates for the reference captured image.

(2) The client terminal according to (1),

wherein the detailed information output control unit controls thedetailed information to be displayed on the display unit or to be outputfrom an audio output unit.

(3) The client terminal according to (1) or (2),

wherein the candidate display control unit controls the candidate forthe reference captured image to be displayed on a map image in a mannerthat the candidate for the reference captured image is associated withan image capturing position of each of the reference captured images.

(4) The client terminal according to (1) or (2),

wherein the candidate display control unit controls the candidate forthe reference captured image to be displayed on a screen of the displayunit on a grip side of the client terminal.

(5) The client terminal according to any one of (1) to (4),

wherein the detailed information output control unit controls thedetailed information to be displayed on a screen on which the candidatefor the reference captured image is displayed.

(6) The client terminal according to any one of (1) to (4),

wherein the detailed information output control unit controls thedetailed information to be displayed on a preview screen for actualimage capture that is switched in response to selection of the referencecaptured image.

(7) The client terminal according to any one of (1) to (6),

wherein the detailed information includes at least any one of an imagecapturing parameter, image capturing position information, and imagecapturing date and time information.

(8) The client terminal according to any one of (1) to (7), furtherincluding:

a parameter setting unit configured to set, in case of being switched toan actual image capturing mode in response to selection of the referencecaptured image, an image capturing parameter included in the detailedinformation attached to the selected reference captured image.

(9) The client terminal according to any one of (1) to (8), furtherincluding:

a guide information display control unit configured to control, in caseof being switched to an actual image capturing mode in response toselection of the reference captured image, actual image capturing guideinformation corresponding to the selected reference captured image to bedisplayed on a preview screen for actual image capture.

(10) The client terminal according to (9),

wherein the actual image capturing guide information includes at leastany one of guide information used to set a composition or an anglesimilar to a composition or an angle of the selected reference capturedimage, and guide information on how to hold the client terminal.

(11) The client terminal according to any one of (1) to (10),

wherein the candidate display control unit controls a position and/or asize of each reference captured image to be displayed depending on scoreinformation attached to the candidate for each reference captured image.

(12) The client terminal according to any one of (1) to (11),

wherein the reference captured image is a photographic subject that isidentical or similar to a photographic subject included in thepreliminary captured image obtained by preliminary image capture, or isa captured image with a composition, an angle, and an effect that areidentical or similar to a composition, an angle, and an effect of thepreliminary captured image.

(13) The client terminal according to any one of (1) to (12),

wherein the candidate display control unit controls a candidate for areference captured image to be displayed on the display unit, thereference captured image being re-retrieved based on an actual capturedimage obtained by actual image capture.

(14) The client terminal according to any one of (1) to (13), furtherincluding:

a receiver configured to receive the candidate for the referencecaptured image from a server.

(15) The client terminal according to any one of (1) to (14), furtherincluding:

a storage unit configured to store the reference captured image; and

a retrieval unit configured to retrieve a candidate for a referencecaptured image from the storage unit based on the preliminary capturedimage obtained by preliminary image capture.

(16) A display control method including:

a step of controlling a candidate for a reference captured image to bedisplayed on a display unit, the reference captured image beingretrieved based on a preliminary captured image obtained by preliminaryimage capture in an imaging unit and being referred to during actualimage capture; and

a step of controlling detailed information to be output, the detailedinformation being attached to a reference captured image selected fromamong the displayed candidates for the reference captured image.

(17) A program for causing a computer to execute:

processing of controlling a candidate for a reference captured image tobe displayed on a display unit, the reference captured image beingretrieved based on a preliminary captured image obtained by preliminaryimage capture in an imaging unit and being referred to during actualimage capture; and

processing of controlling detailed information to be output, thedetailed information being attached to a reference captured imageselected from among the displayed candidates for the reference capturedimage.

(18) A system including:

a client terminal including

-   -   a transmitter configured to transmit a preliminary captured        image obtained by preliminary image capture to a server,    -   a receiver configured to receives a candidate for a reference        captured image from the server, the reference captured image        being retrieved based on the preliminary captured image obtained        by preliminary image capture,    -   a candidate display control unit configured to control the        candidate for the reference captured image received by the        receiver to be displayed on a display unit, and    -   a detailed information output control unit configured to control        detailed information to be output, the detailed information        being attached to a reference captured image selected from among        the displayed candidates for the reference captured image; and

a server including

-   -   a storage unit configured to store the reference captured image,    -   a retrieval unit configured to retrieve a candidate for a        reference captured image from the storage unit based on the        preliminary captured image transmitted from the client terminal,        and    -   a transmitter configured to transmit a candidate for a reference        captured image retrieved by the retrieval unit to the client        terminal.

REFERENCE SIGNS LIST

-   1, 1′ digital camera-   10, 10′ main controller-   10 a preliminary shooting control unit-   10 b reference image candidate display control unit-   10 c detailed information output control unit-   10 d actual shooting guide information display control unit-   10 e parameter setting unit-   10 g reference image retrieval unit-   10 h score management unit-   11 input device-   11 a touch sensor-   11 b shutter button-   11 c zoom lever-   11 d various operation buttons-   12 output device-   12 a display unit-   13, 13′ storage unit-   14 communication unit-   2 server-   20 main controller-   20 a reference image retrieval unit-   20 b score management unit-   23 storage unit-   24 communication unit-   30 indication of “other”-   31 auxiliary line-   33 detailed information-   C1 to C4 reference image candidate-   P1 through-the-lens image (preliminary shot image)-   P3 actual shooting preview screen (through-the-lens image)-   R reference image

What is claimed is:
 1. A client terminal, comprising: an imaging unit; adisplay unit; and at least one processor configured to: control theimaging unit to acquire an image that includes a first photographicsubject; control the display unit to display at least one thumbnailimage of a plurality of thumbnail images associated with the acquiredimage, wherein the at least one thumbnail image is displayed based on afeature quantity of the acquired image such that the at least onethumbnail image is overlaid on a map image to indicate a shootinglocation of the at least one thumbnail image, wherein the map image isdisplayed on the display unit; and control the display unit to attachdetailed information to the at least one thumbnail image.
 2. The clientterminal according to claim 1, wherein the at least one processor isfurther configured to control the display unit to arrange the pluralityof thumbnail images from a corner region of a screen of the display unittoward a center region of the screen, wherein the corner region isadjacent to a grip side of the client terminal.
 3. The client terminalaccording to claim 2, wherein the at least one processor is furtherconfigured to arrange the plurality of thumbnail images based on scoreinformation of each of the plurality of thumbnail images.
 4. The clientterminal according to claim 1, wherein the at least one processor isfurther configured to control the display unit to display the detailedinformation on a preview screen, wherein the preview screen is switchedbased on a user selection that selects at least one thumbnail image fromthe plurality of thumbnail images.
 5. The client terminal according toclaim 4, wherein the at least one processor is further configured toset, based on the user selection of the at least one thumbnail image, animage capturing parameter included in the detailed information attachedto the at least one thumbnail image.
 6. The client terminal according toclaim 4, wherein the at least one processor is further configured tocontrol the display unit to display a guide image based on the selectionof the at least one thumbnail image and based on rotation information,wherein the rotation information indicates a movement to the shootinglocation corresponding to the at least one thumbnail image.
 7. Theclient terminal according to claim 4, wherein the at least one processoris further configured to control the display unit, based on theselection of the at least one thumbnail image, to display cross lines toindicate a composition of the selected at least one thumbnail image. 8.The client terminal according to claim 1, wherein the detailedinformation includes at least one of an image capturing parameter, imagecapturing position information, image capturing date information, orimage capturing time information.
 9. The client terminal according toclaim 1, wherein the at least one thumbnail image includes a secondphotographic subject that is identical or substantially identical to thefirst photographic subject.
 10. The client terminal according to claim1, further comprising a receiver configured to receive the at least onethumbnail image from a server.
 11. The client terminal according toclaim 1, further comprising a storage unit configured to store the atleast one thumbnail image.
 12. A method, comprising: in an apparatusincluding a display unit, an imaging unit, and at least one processor;controlling the imaging unit to acquire an image including aphotographic subject; controlling the display unit to display at leastone thumbnail image associated with the acquired image, wherein the atleast one thumbnail image is displayed based on a feature quantity ofthe acquired image such that the at least one thumbnail image isoverlaid on a map image to indicate a shooting location of the at leastone thumbnail image, wherein the map image is displayed on the displayunit; and controlling the display unit to attach detailed information tothe at least one thumbnail image.
 13. A non-transitory computer-readablemedium having stored thereon, computer-executable instructions which,when executed by at least one processor of an apparatus, causes the atleast one processor to execute operations, the operations comprising:controlling an imaging unit of the apparatus to acquire an imageincluding a photographic subject; controlling a display unit of theapparatus to display at least one thumbnail image associated with theacquired image, wherein the at least one thumbnail image is displayedbased on a feature quantity of the acquired image such that the at leastone thumbnail image is overlaid on a map image to indicate a shootinglocation of the at least one thumbnail image, wherein the map image isdisplayed on the display unit; and controlling the display unit toattach detailed information to the at least one thumbnail image.
 14. Asystem, comprising: a client terminal including: an imaging unitconfigured to acquire an image that includes a photographic subject; afirst transmitter configured to transmit the acquired image to a server;a receiver configured to receive at least one thumbnail image associatedwith the acquired image from the server, wherein the at least onethumbnail image is retrieved based on a feature quantity of the acquiredimage; a display unit configured to display a map image; and at leastone processor configured to: control the display unit to display the atleast one thumbnail image, wherein the at least one thumbnail image isoverlaid on the map image to indicate a shooting location of the atleast one thumbnail image; and control the display unit to attachdetailed information to the at least one thumbnail image; and the serverincluding: a storage unit configured to store the at least one thumbnailimage; and a second transmitter configured to transmit the at least onethumbnail image to the client terminal.